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Attention  and  representation 

Psychologists  often  speak  of  "allocating  attention  to 
stimuli,"  but  in  fact  this  manner  of  speaking  obscures  an 
important  fact  about  attention.  Attention  is  not  allocated 
to  stimuli,  but  to  internal  representations  of  stimuli. 
Although  it  may  seem  pedantic  to  emphasize  such  an  obvious 
point,  doing  so  alerts  us  to  the  central  role  of 
representation  in  any  theory  of  attention.  One  cannot 
explain  attention  without  having  specified  the  nature  of  the 
visual  representations  on  which  it  operates. 

The  goal  of  this  chapter  is  to  characterize  the 
representations  of  visual  stimuli  to  which  attention  is 
allocated.  Two  general  alternatives  will  be  considered.  The 
first  is  that  attention  is  allocated  to  regions  of  an  array- 
format  representation  of  the  visual  field.  According  to  this 
view,  when  some  subset  of  the  contents  of  the  visual  field  is 
selected  for  further,  attention-demanding  perceptual 
processing,  the  attended  subset  is  spatially  delimited.  In 
other  words,  stimuli  are  selected  a  location  at  a  time.  The 
second  alternative  is  that  attention  is  allocated  to  a 
representation  that  makes  explicit  the  objects  in  the  visual 
field,  but  not  necessarily  their  locations,  and  the  attended 
subset  is  therefore  some  integral  number  of  objects. 

According  to  this  alternative,  stimuli  are  selected  an  object 


at  a  time. 
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In  this  chapter  we  will  review  what  is  known  about  the 
representation  of  locations  and  objects  in  visual  attention 
from  studies  of  normal  subjects  and  parietal-damaged 
subjects.  The  latter  include  unilaterally-damaged  subjects, 
who  have  neglect,  and  bilaterally-damaged  subjects,  who  have 
a  disorder  known  as  "simultanagnosia . " 

Attention  to  locations  and  ob-iects: 

A  brief  review  of  evidence  from  normal  subjects 

Evidence  for  location-based  attention.  Most  research  on 
visual  attention  in  normal  subjects  has  focused  on  selection 
of  stimuli  by  spatial  location.  Visual  attention  is  often 
compared  to  a  spotlight  (e.g.,  Posner,  Snyder,  &  Davidson, 
1980),  which  is  moved  across  locations  in  the  visual  field. 
One  common  task  used  in  studying  spatial  attention  is  the 
simple  reaction  time  paradigm  developed  by  Posner  and 
colleagues,  in  which  cues  and  targets  appear  to  the  left  and 
right  of  fixation  as  shown  in  Figure  1.  The  cue  consists  of 
a  brightening  of  the  box  surrounding  the  target  location  and 
the  target  itself  is  a  plus  sign  inside  the  box.  '^re 
subject's  task  is  to  respond  as  quickly  as  possible  once  the 
target  appears.  The  cues  precede  the  targets,  and  occur 
either  at  the  same  location  as  the  target  fa  "valid"  cue)  or 
at  the  other  location  (an  "invalid"  cue) .  Subjects  respond 
more  quickly  to  validly  than  invali'.iiy  cued  targets,  and  this 
difference  has  been  interpreted  as  an  attentional  effect. 
Specifically,  when  a  target  is  invalidly  cued,  attention  must 
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be  disengaged  from  the  location  of  the  cue,  moved  to  the 
location  of  the  target,  and  re-engaged  there  before  the 
subject  can  comp^pte  a  response.  In  contrast,  when  the 
target  is  validly  cued,  attention  is  already  engaged  at  the 
target's  location,  and  responses  are  therefore  faster  (see 
Posner  &  Cohen,  1984) . 


insert  Figure  1  about  here 


The  hypothesis  that  attention  is  shifted  across  a 
representation  of  locations  in  the  visual  field  also  finds 
stri)cing  support  from  an  experiment  by  Shulman,  Remington, 
and  McLean  (1979).  Subjects  received  cues  and  targets  in  far 
peripheral  locations.  However,  a  probe  event  could  occur 
between  the  cue  and  target  in  an  intermediate  peripheral 
location.  When  subjects  were  cued  to  a  far  peripheral 
location  and  a  probe  appeared  in  the  intermediate  location, 
subjects  showed  facilitation  in  processing  the  probe  prior  to 
the  maximal  facilitation  of  the  far  peripheral  location. 

These  results  fit  with  the  idea  that  if  attention  is  moved 
from  point  A  to  point  B  through  space,  then  it  moves  through 
the  intermediate  points. 

Another  representative  result  supporting  spatially 
allocated  visual  attention  was  reported  by  Hoffman  and  Nelson 
(1981).  Their  subjects  were  required  to  perform  two  taslcs; 

A  letter  search  taslc,  in  which  subjects  determined  which  of 
two  target  letters  appeared  in  one  of  four  spatial  locations, 
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and  an  orientation  discrimination,  in  which  subjects 
determined  the  orientation  of  a  small  U-shaped  figure. 

Hoffman  and  Nelson  found  that  when  letters  were  correctly 
identified,  the  orientation  of  the  U-shaped  figure  was  better 
discriminated  when  it  was  adjacent  to  the  target  letter, 
compared  to  when  the  target  letter  and  U-shape  were  not 
adjacent.  These  results  support  the  hypothesis  that 
attention  is  allocated  to  stimuli  as  a  function  of  their 
location  in  visual  space. 

Evidence  for  object-based  attention.  In  addition  to  the 
many  results  supporting  the  view  that  attention  is  allocated 
to  representations  of  spatial  locations,  there  are  other 
results  suggesting  that  it  is  allocated  to  representations  of 
objects,  independent  of  their  spatial  location.  Perhaps  the 
clearest  evidence  for  object-based  attention  comes  from 
Duncan  (1984).  Duncan  presented  subjects  with  brief 
presentations  of  superimposed  boxes  and  lines,  like  the  ones 
shown  in  Figure  2.  Each  of  the  two  objects  could  vary  on  two 
dimensions;  The  box  could  be  either  short  or  tall  and  have  a 
gap  on  the  left  or  right,  and  the  line  could  be  tilted 
clockwise  or  counterclockwise  and  be  either  dotted  or  dashed. 
The  critical  finding  was  that  when  subjects  were  required  to 
make  two  decisions  about  the  stimuli,  they  were  more  accurate 
when  both  decisions  were  about  the  same  object.  For  example, 
subjects  were  more  accurate  at  reporting  the  box's  size  and 
side  of  gap,  compared  to,  say,  reporting  the  box's  height  and 
the  line's  texture.  This  finding  fits  with  the  notion  that 
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attention  is  allocated  to  objects  per  se:  It  would  be  more 
efficient  to  attend  to  a  single  object  representation  rather 
than  either  attending  to  two  object  representations 
simultaneously,  or  attending  to  one  representation  and  then 
the  other. 


insert  Figure  2  about  here 


To  summarize  the  findings  with  normal  subjects,  there 
appears  to  be  evidence  of  both  location-based  and  object- 
based  attention.  It  is  also  possible  that  the  findings  in 
support  of  one  type  of  attention  could  be  explained  by  the 
alternative  hypothesis.  In  general,  being  in  the  same 
location  is  highly  correlated  with  being  on  the  same  object 
and  vice  versa.  This  raises  the  possibility  that  there  is 
just  one  type  of  visual  attention,  either  location-based  or 
object-based.  For  example,  in  the  type  of  display  shown  in 
Figure  1,  the  cue-target  combination  might  be  seen  as  forming 
a  single  object  —  a  box  with  a  plus  inside  —  when  the  cue 
occurs  on  the  same  side  of  space  as  the  target,  whereas  a  box 
on  one  side  of  space  and  a  plus  on  the  other  would  not  be 
grouped  together  as  a  single  object.  The  tendency  of  the 
visual  system  to  group  stimuli  at  adjacent  spatial  locations 
into  objects  (the  Gestalt  principle  of  grouping  by  proximity) 
could  be  used  to  explain  the  effects  of  spatial  location  on 
the  allocation  of  attention  in  terms  of  object-based 
attention.  Similarly,  evidence  for  object-based  attention 
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could  be  interpreted  in  terms  of  spatial  attention.  For 
example,  Duncan  discusses  the  possibility  that  the  objects  in 
his  experiment  may  have  been  perceived  as  being  at  different 
depths,  so  that  shifting  attention  between  objects  may  in 
fact  have  involved  shifting  attention  to  a  different  depth 
location.  It  is,  of  course,  also  possible  that  both  types  of 
attention  exist.  The  current  state  of  research  with  normal 
subjects  does  not  decisively  choose  among  these  alternatives. 
Let  us  now  turn  to  neuropsychological  evidence  on  this  issue. 

Attention  to  locations  and  objects  after  unilateral  parietal 

Unilateral  posterior  parietal  damage  often  results  in 
the  neglect  syndrome,  in  which  patients  may  fail  to  attend  to 
the  contralesional  side  of  space,  particularly  when 
ipsilesional  stimuli  are  present.  The  neglect  syndrome 
provides  clear  evidence  for  a  location-based  visual  attention 
system,  in  that  what  does  and  does  not  get  attention  depends 
on  location,  specifically  how  far  to  the  left  or  right  a 
stimulus  is.  Patients  with  right  parietal  damage,  for 
example,  tend  to  neglect  the  left  to  a  greater  extent  than 
the  right,  no  matter  where  the  boundaries  of  perceived 
objects  lay.  This  fundamentally  spatial  limitation  of 
attention  cannot  be  explained  in  terms  of  object -based 
attentional  processes. 

It  is,  of  course,  possible  that  visual  attention  has 
both  location-based  components  and  object-based  components. 
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The  following  experiments  test  the  possibility  that  there  is 
an  object -based  component  of  attention  contributing  to 
neglect  patients'  performance,  as  well  the  more  obvious 
location-based  component. 

Object-based  attention  in  neglect.  We  set  out  to 

discover  whether  or  not  object  representations  play  a  role  in 
the  distribution  of  attention  in  neglect.  Eight  right 
parietal-damaged  patients  with  left  neglect  were  given  a 
visual  search  task,  in  which  they  had  to  name  all  of  the 
letters  they  could  see  in  a  scattered  array.  Figure  3  shows 
the  two  types  of  stimuli  that  were  used.  The  patient  was 
simply  asked  to  read  as  many  letters  as  they  could  see,  and 
tell  us  when  they  were  finished.  Note  that  the  blob  objects 
are  completely  irrelevant  to  the  task.  Of  course,  they  are 
perceived  by  at  least  some  levels  of  the  visual  system,  and 
so  the  question  is  what,  if  anything,  does  that  do  to  the 
distribution  of  attention  over  the  stimulus  field? 


insert  Figure  3  about  here 


If  attention  is  object-based  as  well  as  location-based, 
then  there  will  be  a  tendency  for  entire  blobs  to  be  either 
attended  or  nonattended,  in  addition  to  the  tendency  for  the 
right  to  be  attended  and  the  left  to  be  nonattended.  Thi 5 
leads  to  different  predictions  for  performance  with  the 
horizontal  and  vertical  blobs.  Each  of  the  horizontal  blobs 
will  be  at  least  partially  attended  because  they  extend  into 


8 


the  right  hemifield.  On  the  hypothesis  that  attention  is 
allocated  to  entire  objects,  then  even  their  left  side  will 
receive  some  additional,  object-based,  attention.  The 
hypothesis  of  object-based  attention  therefore  predicts  that 
there  will  be  more  attention  allocated  to  the  left  when  the 
blobs  are  horizontal  and  straddle  the  two  sides  of  space  then 
when  they  are  vertical  and  each  contained  within  one  side. 
Note  that  the  letters  and  their  locations  are  perfect!'' 
matched  for  all  pairs  of  horizontal  and  vertical  blobs,  so 
any  difference  in  performance  can't  be  due  to  differences  in 
the  location-based  allocation  of  attention. 

We  examined  two  measures  of  the  distribution  of 
attention  in  the  search  task.  The  simplest  measure  is  the 
number  of  letters  correctly  reported  from  the  leftmost  third 
of  the  displays.  Consistent  with  the  object-based 
hypothesis,  all  but  one  subject  read  more  letters  c  the  left 
when  the  blobs  were  horizontal  and  therefore  straddled  the 
left  and  right  hemifields.  One  might  wonder  whether  this 
measure  of  performance  reflects  the  effects  of  the  blobs  on 
spatial  distribution  of  attention  per  se  over  the  display,  or 
whether  it  reflects  the  effects  of  the  blobs  on  subjects' 
search  strategy  adopted  in  the  presence  of  a  rightward  (i.e., 
location-based)  attentional  bias  that  is  not  itself  affected 
by  the  blobs.  That  is,  it  is  possible  that  subjects 
generally  started  on  the  right  sides  of  both  kinds  of 
displays,  and  allowed  their  search  path  to  be  guided  by  the 


boundaries  of  the  blobs.  This  would  lead  them  to  read  more 
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letters  on  the  left  with  the  horizontal  blobs  than  with  the 
vertical  blobs.  Our  second  measure  allows  us  to  rule  this 
possibility  out .  We  examined  the  frequency  with  which 
subjects  started  their  searches  on  the  left.  Consistent  with 
an  effect  of  the  blobs  on  the  distribution  of  attention  at 
the  beginning  of  each  visual  search,  all  subjects  started 
reading  letters  on  the  left  more  often  with  the  horizontal 
blobs  than  with  the  vertical  blobs. 

The  results  of  this  expr^riment  suggest  that  objects  do 
affect  the  distribution  of  attention  in  neglect,  and  imply 
that  visual  attention  is  object-based  as  well  as  location- 
based.  These  results  do  not  tell  us  much  about  how  the 
visual  attention  system  identifies  objects,  asiae  from  the 
low-level  figure-ground  segregation  processes  tnat  are 
requirea  to  parse  the  displays  shown  in  Figure  3  into  blob 
objects.  Does  knowledge  also  play  a  role  in  determining  what 
the  visual  attention  system  takes  to  be  an  object? 

What  does  the  attention  systerr.  know  about  "objects”  in 
neglect?  In  order  to  find  out  whether  the  damaged  attention 
system  in  neglect  takes  knowledge  about  objects  into  account 
when  allocating  attention,  or  merely  takes  objects  to  be  the 
products  of  low-level  grouping  principles,  we  followed  up  on 
a  phenomenon  first  observed  by  Sieroff,  Pollatsek  and  Posner 
(1988;  Brunn  &  Farah,  1990) .  They  observed  that  neglect 
patients  are  less  likely  to  neglect  the  left  half  of  a  letter 
string  if  the  string  makes  a  word  than  if  it  makes  a  nonword. 
For  example,  patients  are  less  likely  to  omit  or  misread  the 
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”t"  in  "table"  than  in  "tifcl."  Sieroff  and  Posner  have 
assumed  that  the  spatial  distribution  of  attention  is  the 
same  when  reading  words  and  nonwords,  and  that  the  difference 
in  reading  performance  for  words  and  nonwords  is  attributable 
to  top-down  support  from  word  representations  "filling  in" 
the  missing  low-level  information.  However,  there  is  another 
possible  explanation  for  the  superiority  of  word  over  nonword 
reading  in  neglect  patients,  in  terms  of  object -based 
attentional  processes.  Just  as  a  blob  object  straddling  the 
two  hemifields  causes  a  reallocation  of  attention  to  the 
leftward  extension  of  the  blob,  because  attention  is  being 
allocated  to  whole  blobs,  so,  perhaps,  might  a  lexical  object 
straddling  the  two  hemifields  cause  a  reallocation  of 
attention  to  the  leftward  extension  of  the  word.  Of  course, 
this  would  imply  that  the  "objects"  that  attention  selects 
can  be  defined  by  very  abstract  properties  such  as 
familiarity  of  pattern,  as  well  as  low-level  physical 
features . 

In  order  to  test  this  interpretation  of  Sieroff  et  al.'s 
observation,  and  thereby  determine  whether  familiarity  can  be 
a  determinant  of  objecthood  for  the  visual  attention  system, 
we  devised  the  following  two  tasks.  In  one  task,  we  showed 
word  and  nonword  letter  strings  printed  in  different  colors, 
as  shown  in  Figure  4,  and  asked  patients  to  both  read  the 
letters  and  to  name  the  colors  —  half  read  the  letters 
first,  half  named  the  colors  first.  Color  naming  is  a 
measure  of  how  well  they  are  perceiving  the  actual  stimulus, 


independent  of  whatever  top-down  support  for  the  orthographic 
forms  there  might  be.  If  there  is  a  reallocation  of 
attention  to  encompass  entire  objects,  in  this  case  lexical 
objects,  then  patients  should  be  more  accurate  at  naming  the 
colors  on  the  left  sides  of  words  than  nonwords.  In  a  second 
task,  we  used  line  bisection  to  assess  the  distribution  of 
attention  during  word  and  nonword  reading.  Here,  the  task 
was  to  mark  the  center  of  the  line  that  was  presented 
underneath  a  letter  string.  If  there  is  a  reallocation  of 
attention  to  encompass  the  entire  word,  then  line  bisection 
should  be  more  symmetrical  with  words  than  nonwords. 


insert  Figure  4  about  here 


In  both  tasks,  we  replicated  Seiroff  et  al.,  in  that 
more  letters  from  words  than  nonwords  were  read  in  both 
experiments.  Was  this  despite  identical  distributions  of 
attention  in  the  two  conditions,  or  was  attention  allocated 
more  to  the  leftward  sides  of  word  than  nonword  letter 
strings?  The  answer  was  found  by  looking  at  performance  in 
the  color-naming  and  line-bisection  conditions.  In  both  of 
these  tasks,  performance  was  significantly  better  with  words 
than  nonwords.  This  implies  that  lexical  "objects,"  like  the 
blob  objects  of  the  previous  experiment,  tend  to  draw 
attention  to  their  entirity.  In  terms  of  the  issue  of  what 
determines  objecthood  for  the  allocation  of  attention,  these 
results  suggest  that  knowledge  does  indeed  play  a  role. 
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To  summarize  the  conclusions  that  can  be  drawn  from 
these  studies  of  patients  with  neglect,  it  appears  that 
attention  is  both  location-based  and  ob ject -based . 
Furthermore,  the  object  representations  to  which  attention 
can  be  allocated  include  such  abstract  objects  as  words. 

Attention  to  locations  and  objects  after  bilateral  parietal 

damage 

Patients  with  bilateral  posterior  parietal  damage 
sometimes  display  a  symptom  known  as  "simultanagnosia, "  or 
"dorsal  simultanagnosia"  (to  distinguish  this  syndrome  from  a 
superficially  similar  but  distinct  syndrome  that  follows 
ventral  visual  system  damage;  see  Farah,  1990)  .  They  may  have 
full  visual  fields,  but  are  nevertheless  able  to  see  only  one 
object  at  a  time.  This  is  manifest  in  several  ways:  When 
shown  a  complex  scene,  they  will  report  seeing  only  one 
object;  when  asked  to  count  even  a  small  number  of  items, 
they  will  loose  track  of  each  object  as  soon  as  they  have 
counted  it  and  therefore  tend  to  recount  it  again;  if  their 
attention  is  focussed  on  one  object,  they  will  fail  to  see 
even  so  salient  a  stimulus  as  the  examiner's  finger  being 
thrust  suddenly  towards  their  face.  Not  surprisingly,  given 
the  typical  lesions  causing  this  syndrome,  these  patients 
have  been  described  as  having  a  kind  of  bilateral  neglect 
(e.g.,  Bauer  &  Rubens,  1985). 

Like  neglect,  dorsal  simultanagnosia  seems  to  involve 
both  location-  and  object-based  limitations  on  attention. 
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Many  authors  report  better  performance  with  small,  foveally 
located  stimuli  (e.g.  Holmes,  1918;  Tyler,  1968), 
demonstrating  the  role  of  spatial  limitations  on  the 
attentional  capacities  of  these  patients.  In  addition, 
simultanagnosic  patients  tend  to  see  one  object  at  a  time. 
Luria  and  colleagues  provided  some  particularly  clear 
demonstrations  of  the  object-limited  nature  of  the 
impairment .  In  one  experiment  (Luria,  Pravdina-Vinarskaya  & 
Yarbus,  1963),  a  patient  was  shown  simple  shapes  and  line 
drawings,  such  as  a  circle,  cross,  carrot  or  fork,  in  a 
tachistoscope .  He  could  name  the  stimuli  when  presented  one 
at  a  time,  whether  they  were  small  (6-8°)  or  large  (15-20°). 
However,  when  shown  simultaneously,  even  at  the  smaller  size, 
the  patient  could  not  name  both.  Note  that  the  angle 
subtended  by  the  pair  of  smaller  stimuli  would  have  been  no 
larger  than  a  single  large  stimulus.  This  confirms  that 
there  is  an  object  limitation  per  se,  rather  than  a  spatial 
limitation,  in  the  subject's  ability  to  attend  to  visual 
stimuli . 


insert  Figure  5  about  here 


Given  that  the  limitation  of  attention  seems  not  to 
depend  upon  size  per  se,  is  it  truly  a  function  of  number  of 
objects,  or  is  it  merely  a  limitation  on  some  measure  of 
complexity?  The  foregoing  observations  by  Luria  are 
consistent  with  both  possibilities,  as  two  shapes  taken 
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the  fixed  environment,  but  not  relative  to  the  intrinsic 
left/right  of  an  object  (Farah,  Brunn,  Wong,  Wallace  & 
Carpenter,  1990) .  That  is,  when  they  recline  sideways,  the 
allocation  of  their  attention  is  determined  by  where  their 
personal  left  is  (up  or  down  with  respect  to  the  fixed 
environment)  as  well  as  where  the  left  side  of  the 
environment  is.  In  contrast,  when  neglect  patients  view  an 
object  with  an  intrinsic  left  and  right  (such  as  a  telephone) 
turned  sideways,  the  allocation  of  their  attention  is  not 
altered.  This  is  not  inconsistent  with  the  hypothesis  that 
neglect  patients  allocate  attention  to  objects.  Rather,  it 
implies  that,  when  neglect  patients  allocate  attention  to 
locations ,  those  locations  are  represented  with  respect  to 
two  different  coordinate  systems,  viewer-centered  and 
environment-centered,  but  not  to  an  object-centered 
coordinate  system.  In  other  words,  attention  is  allocated  to 
objects  as  well  as  to  locations,  but  objects  do  not  help  to 
determine  which  locations  the  attention  system  ta)ces  to  be 
"left"  and  "right." 

Visual  attention  and  the  two  cortical  visual  systems. 

An  influential  organizing  framework  in  visual  neurophysiology 
has  come  to  be  known  as  the  "two  cortical  visual  systems" 
hypothesis  (Underleider  &  Mishkin,  1982).  According  to  this 
hypothesis,  higher  visual  perception  is  carried  out  by  two 
relatively  distinct  neural  pathways  with  distinct  functions. 
The  dorsal  visual  system,  going  from  occipital  cortex  through 
posterior  parietal  cortex,  is  concerned  with  representing  the 


spatial  characteristics  of  visual  stimuli,  primarily  their 
location  in  space.  Animals  with  lesions  of  the  dorsal  visual 
system  are  impaired  at  tasks  involving  location 
discrimination,  but  perform  normally  at  tasks  involving 
pattern  discrimination.  Single  cell  recordings  show  that 
neurons  in  this  region  of  the  brain  respond  to  stimuli 
dependent  primarily  on  the  location  of  the  stimuli,  and  not 
their  shape  or  color.  The  ventral  visual  system,  going  from 
occipital  cortex  through  inf erotemporal  cortex,  is  concerned 
with  representing  the  properties  of  stimuli  normally  used  for 
identification,  such  as  shape  and  color.  Animals  with 
lesions  disrupting  this  pathway  are  impaired  at  tasks  that 
involve  shape  and  color  discrimination,  but  perform  normally 
on  most  tasks  involving  spatial  discriminations.  Consistent 
with  these  findings,  recordings  from  single  neurons  in 
inferotemporal  cortex  reveal  little  spatial  selectivity  for 
location  or  orientation,  but  high  degrees  of  selectivity  for 
shape  and  color.  Some  neurons  in  this  area  respond 
selectively  to  shapes  as  complex  as  a  hand  or  eve^i  a 
particular  individual's  face. 

The  findings  reviewed  earlier  seem  in  conflict  with  the 
classical  view  of  the  two  cortical  visual  systems,  in  that 
patients  with  bilateral  damage  to  the  dorsal  system  suffer  a 
limitation  on  object-based  attention  as  well  as  location- 
based  attention.  The  results  from  dorsal  simultanagnosics 
and  neglect  patients  seem  to  imply  that  the  dorsal  visual 
system  represents  objects,  even  words.  Actually,  these 


results  imply  only  that  the  dorsal  visual  system  is  part  of 
an  interactive  network,  other  parts  of  which  have  object  and 
word  knowledge.  An  outline  of  one  possible  model  that  would 
account  for  these  results  is  shown  in  Figure  6. 


insert  Figure  6  about  here 


According  to  the  ideas  sketched  out  in  Figure  6,  the 
effects  of  objects  on  the  allocation  of  attention  can  be 
explained  as  a  result  of  interactions  between  the  object 
representations  needed  for  object  recognition  and  the  array- 
format  representation  of  the  visual  field  that  is  operated  on 
by  attention.  One  of  the  basic  problems  in  object 
recognition  is  to  parse  the  array  into  regions  that 
correspond  to  objects,  which  can  then  be  recognized.  This  is 
a  difficult  problem  because  objects  in  the  real  world  often 
overlap  and  occlude  each  other.  One  good  source  of  help  in 
segmenting  the  visual  field  into  objects  is  our  knowledge  of 
what  objects  look  like.  Unfortunately,  this  puts  us  in  a 
chicken-and-egg  situation,  in  that  the  configuration  of 
features  in  the  array  can  be  used  to  determine  what  objects 
are  being  seen,  but  we  need  to  know  what  objects  are  being 
seen  to  figure  out  how  to  parse  the  features  in  order  to  feed 
them  into  the  object  recognition  system,  A  good  solution  to 
this  kind  of  problem  is  what  McClelland  and  Rumelhart  (1981) 
call  an  interactive  activation  system,  in  which  the  contents 
of  the  array  put  constraints  on  the  set  of  candidate  objects 
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at  t-hp  samp  time  as  the  set  of  candidate  objects  put 
constraints  on  how  the  contents  of  the  array  should  be 
segmented.  What  this  means  in  terms  of  activation  flow  in 
Figure  6  is  that  the  contents  of  the  array  are  activating 
certain  object  representations  in  the  ventral  visual  system, 
and  that  the  activated  object  representations  are 
simultaneously  activating  the  regions  of  the  array  that 
correspond  to  an  object. 

The  interactive  activation  relation  between  the  object 
representations  and  the  array-format  representation  of  the 
visual  field  implies  that  there  are  two  sources  of  activation 
in  the  array,  both  of  which  will  have  the  potential  to  engage 
the  dorsal  attention  system:  Bottom-up  activation  from 
stimulus  input,  and  top-down  activation  from  object 
representations.  Whereas  stimulus  input  can  activate  any 
arbitrary  configuration  of  locations,  top-down  activation 
from  the  object  system  will  activate  regions  of  the  array 
that  correspond  to  objects.  Thus,  the  dorsal  attention 
system  will  tend  to  be  engaged  by  regions  of  the  array  that 
are  occupied  by  objects,  including  objects  defined  by  the 
kinds  of  knowledge  stored  in  the  ventral  visual  system. 
Whether  or  not  this  is  the  correct  interpretation  of  the 
object-based  attention  effects  in  normal  and  brain-damaged 
subjects  awaits  further  experimental  tests.  At  present,  it 
is  useful  merely  as  a  demonstration  that  one  need  not  abandon 
the  basic  assumptions  of  the  two  cortical  visual  systems 
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hypothesis  in  order  to  account  for  object  effects  in  the 
attentional  limitations  of  parietal-damaged  patients. 
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Figure  Captions 

Figure  1.  Two  sequences  of  stimulus  displays  from  the  simple 
reaction  time  paradigm  used  by  Posner  and  colleagues  to 
demonstrate  spatially  selective  attention.  Part  A  shows  a 
validly  cued  trial,  in  which  the  cue  (brightening  of  one  box) 
occurs  on  the  same  side  of  space  as  the  target  (asterisk)  . 
Part  B  shows  an  invalidly  cued  trial,  in  which  the  cue  and 
target  occur  in  different  spatial  locations. 

Figure  2.  Examples  of  stimuli  used  by  Duncan  (1984)  to 
demonstrate  that  attention  is  object-based. 

Figure  3.  Examples  of  stimuli  used  to  demonstrate  a  object- 
based  component  to  visual  attention  in  neglect  patients. 

Figure  4.  Examples  of  stimuli  used  by  Brunn  and  Farah  (1991) 
to  demonstrate  that  the  lexicality  of  letter  strings  affects 
the  distribution  of  visual  attention  in  neglect  patients. 

Figure  5.  Examples  of  stimuli  used  by  Luria  (1959)  to 
demonstrate  object-based  attentional  limitations  in  a  dorsal 
simultanagnosic  patient.  The  patient  was  more  likely  to  see 
multiple  shapes  if  they  were  connected  by  a  line,  as  shown  in 
Part  A.  When  the  star  shown  in  Part  B  was  presented  in  a 
single  color,  the  patient  saw  a  star,  but  when  each  component 
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Figure  Captions,  continued. . . 

triangle  was  drawn  in  a  different  color,  he  saw  only  a  single 
triangle . 

Figure  6.  A  sketch  of  the  possible  relations  between 
location-based  representations  of  the  visual  world,  visual 
attention,  and  object  representations. 
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